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A class of Markov stochastic processes x t , suitable as models for random 
traffic in connecting networks with blocked calls cleared, is described and 
analyzed. These models take into account the structure of the connecting 
network, the set S of its permitted states, the random epochs at which new 
calls are attempted and calls in progress are ended, and the method used for 
routing calls. 

The probability of blocking, or the fraction of blocked attempts, is defined 
in a rigorous way as the stochastic limit of a ratio of counter readings, and 
a formula for it is given in terms of the stationary probability vector p of 
x t . This formula is 

ziS 

where X is the number of blocked idle inlet-outlet pairs in state x, and 
a x is the number of idle inlet-outlet pairs in state x. On the basis of this 
formula, it is shown that in some cases a simple algebraic relationship 
exists between the blocking probability b, the traffic parameter X (the calling 
rate per idle inlet-outlet pair), the mean m of the load carried, and the 
variance a of the load carried. For a one-sided connecting network of T 
inlets (= outlets), this relation is 



X (T - 2m) 2 - (T - 2m) + 4a 2 ' 

for a two-sided network with N inlets on one side and M outlets on the other, 
it is 

1 - b « 



(N - m)(M - m) + a 2 ' 
2795 
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The problem of calculating the vector p of stationary state probabilities 
is fully resolved in principle by three explicit formulas for the components 
of p: a determinant formula, a sum of products along paths on S, and an 
expansion in a power series around any point X ^ 0. The formulas all 
indicate how these state probabilities depend on the structure of the connect- 
ing network, the traffic parameter X, and the method of routing. 
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I. INTRODUCTION 

A connecting system is a physical communication system consisting of 
(i) a set of terminals, (u) a control unit which processes the information 
needed to set up calls, and (Hi) a connecting network through which 
calls are switched between terminals. 

Connecting systems have been described heuristically and at length 
in a previous paper. 1 Also, some of the algebraic and topological prop- 
erties of connecting networks have been studied in another paper. 2 
The models to be used here have been described (but not studied) in 
a third paper. 3 These papers are a source of background material for 
reading the present one; familiarity with them is desirable, but is not 
presupposed. 

The principal problem treated here is the exact theoretical calculation 
of the grade of service (as measured by the probability of blocking) 
of a connecting network of given but arbitrary structure; the calcula- 
tion is to be carried out in terms of a mathematical model for the opera- 
tion of the network. The model used here is a Markov stochastic process 
x t defined by some simple probabilistic and operational assumptions. 
The problem is first reduced to calculation of the stationary probability 
vector p of x t from the "statistical equilibrium" equations. From the 
form of this reduction it follows that in many cases of practical interest 
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the probability of blocking is uniquely determined by the mean and 
variance of the carried load, a fact heretofore known only for very simple 
systems. 

In the past, the application of A. K. Erlang's very natural method of 
statistical equilibrium has been visited by a curse of dimensionality, 
that is, by the extremely large number of equations comprised in the 
equilibrium condition. This difficulty has not only put explicit solutions 
apparently out of the question ; it has even made it effectively impossible 
to reach a reliable qualitative idea of the dependence of the blocking 
probability on the structure of the network, the method of routing, etc. 

Three explicit formulas for the solution p of the equilibrium equations 
will be given. One is based on purely algebraic considerations, and the 
others largely on combinatory and probabilistic notions. Because of the 
generality of the model with respect to network structure, these formulas 
are of necessity rather complex. Except in simple cases, they cannot be 
regarded as giving a final (or even a working) solution to the problem 
of calculating equilibrium probabilities. Still, they expose the mathe- 
matical character of the problem, and provide a badly needed starting 
point for well grounded approximations. For only after one has studied 
and understood this character can he seriously consider ignoring some 
of it in approximations. 

II. PRELIMINARY REMARKS AND DEFINITIONS 

Various combinatory, algebraic, and topological features of the con- 
necting network play important roles in the analysis of stochastic 
models for network operation. Some of these features will now be de- 
scribed, and terminology and notations for them introduced. 

Let S be the set of permitted (i.e., physically meaningful) states of 
the connecting network under study. It has been pointed out in earlier 
work 1 - 2 that these states are partially ordered by inclusion ^ , where 

x ^ y 

means that state x can be obtained from state y by removing zero or 
more calls. Also, these states can be arranged (in fact, partitioned) in an 
intuitive manner in a slate-diagram, the Hasse figure for the partial 
ordering ^ . This figure is a graph constructed by partitioning the states 
in horizontal rows according to the number of calls in progress, the kth 
row consisting of all states with k calls in progress. The unique zero, 
or empty, state of the network, in which no calls are in progress, is 
placed at the bottom of the figure; above it comes the row consisting 
of states with exactly one call in progress, and so on. The figure is com- 
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pleted by drawing a graph with the states as nodes, and with adjacency 
matrix determined by the condition that states differing by exactly 
one call are adjacent. This means that in drawing the graph we place 
lines between states (in successive rows) that differ in point of one call. 
A maximal state is one that forms a summit of the state-diagram, i.e., 
has no states above it in the partial ordering. 

For most systems the state-diagram has the following heuristic de- 
scription: there is a unique "point" at the bottom corresponding to the 
zero state; there are usually many "points" at the top corresponding 
to the maximal states; and the diagram is very "fat" in the middle, 
because of the multitude of states with a moderate number of calls in 
progress. 

We mention at this point that usually the number of states, i.e., the 
number of elements of 8, is astronomically large. Indeed, this fact has 
been a principal obstacle to theoretical progress on problems of con- 
gestion in large connecting systems. For an illustration, in the network 
of No. 5 Crossbar type, illustrated in Fig. 1, made for 1000 lines out of 
square 10 X 10 switches, the number of maximal states alone is 

(100 X 10!) 4 = 1.734 X 10 34 . 

The set of inlets of a connecting network is denoted by I, and the set 
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Fig. 1 — Structure of No. 5 Crossbar network. 
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of outlets by 12. It is possible that / H 12 = 0, that / H 12 ?^ <£, or even that 
/ = 12, i.e., that all inlets are also outlets, depending on the "community 
of interest" aspects of the structure of the network. It is assumed that 
every call or connection is made only between an inlet and an outlet. 

If x is a state, the notation | z | (read "the norm of x") will denote 
the number of calls in progress in state x. If X is a set, then | .r | will 
denote the cardinality of X, i.e., the number of elements of X. We 
define the levels 

Lk = \x e S: | x | = k), k = 0, 1, • • • , max | x \, 

XtS 

as the sets of states in which a specified number of calls is in progress. 
The j Lk\ form a partition of S, 

U U = S 

k 

L k D Lj = 0, A- 9± j. 

The "neighbors" of a state x are just those states which can be reached 
from x by adding or removing one call. These neighbors y of x can be 
divided into two sets according as y > x or // < x; so we are led to 
define 

A x = set of neighbors above x 

= set of states accessible from x by adding one call 
B x = set of neighbors below x 

= set of states accessible from x by removing one call. 

III. SUMMARY 

The basic probabilistic assumptions that define the randomness in 
the traffic models to be studied are given precise statement in Section 

IV. They are, briefly, (i) the hang-up rate per call in progress is unity, and 
(ii) the calling rate per idle inlet-outlet pair is a constant X > 0. Vari- 
ous operational aspects, such as the disposition of lost calls, and the 
method of routing, are specified and discussed in Section V. It is as- 
sumed that lost calls are refused without a change in state, and that 
routes for calls are chosen in a way that depends both on the call being 
set up or processed and on the current state of the system. In Section 
VI these probabilistic and operational assumptions are summarized in 
a transition rate matrix, Q. In Section VII, a Markov stochastic process 
Xt (the mathematical model for the operating system) is defined, and 
the statistical equilibrium condition Qp = for the stationary proba- 
bility vector p of x t is formulated. 
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In Section VIII, the probability b of blocking is denned as the (prob- 
ability one) limit of a ratio of counter readings, and a formula for b 
is given in terms of the stationary vector p. From this formula it is 
shown, in Section IX, that a simple algebraic relationship often exists 
between the blocking probability b, the traffic parameter X, the mean 
load carried, and the variance of the load carried. 

The remainder of the paper is devoted to the study and calculation 
of the vector p of stationary probabilities. Two explicit solutions, one 
algebraic and one combinatory in character, are given in Section X. 
In Section XI it is shown that the combinatory solution is a special 
case of a general formula for the stationary measure of an ergodic 
Markov process. The dependence of p = p(X) on the network structure 
and the method of routing is analyzed in an elementary way in Section 
XII. It is first shown that p( ■ )/p ( ■ ) has components that are analytic 
in a neighborhood of the nonnegativc real axis, and so are expressible 
in the form 

—. j v = Z, « Cm(X,li). 

For n = and e = X sufficiently small, this gives an expansion of p 
in powers of X. It is then shown that with | x | the number of calls in 
progress in state x, p x is of order X 1 " ' as X -> 0. This result renders 
possible a recursive calculation (Sections XII and XIV) of the coeffi- 
cients c m (.r,0) from the partial ordering ^ of S and a matrix used to 
specify the method of routing. Once p is developed as a power series in 
X, a similar expansion is readily given (Section XIII) for the probability 
b of blocking. 

In Section XV, finally, we completely solve the problem of calculating 
the coefficients c m (.r,X) for arbitrary values of X > 0, giving each such 
coefficient both a combinatory interpretation, and an explicit formula, 
viz., a sum of products along paths through S which are trajectories 
for x t permitted by the routing rule. 

IV. PROBABILITY 

To construct a Markov process for representing the random trajectory 
of the operating network through the set S of states, we shall make two 
simple probabilistic assumptions. The traffic models to be studied em- 
body what has come to be known as a "finite-source effect," that is, 
a dependence of the instantaneous total calling-rate on the number of 
idle inlets, and on that of idle outlets. 

In an attempt to describe this dependence in a simple rational way, 
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let us imagine a customer located at one of the inlets [outlets] of the 
connecting network, and seek to assign him a calling-rate, assuming 
that he is in an idle condition. We shall suppose that the traffic he offers 
is homogeneous in the sense that he calls every outlet [inlet] at the same 
rate, or with the same frequency. Indeed, we shall assume that all 
customers offer homogeneous traffic. Now on most occasions when he 
is making a call, a customer does not know whether the terminal he is 
calling is busy or idle. Thus, if he is on an inlet [outlet] it seems reason- 
able to suppose that there is a probability 

Xh + o(h) X > 

that he attempts a call to a particular outlet [inlet] (distinct from his 
own) in the next interval of time of length h, as h — * 0, whether that 
outlet [inlet] is busy or not. The qualifying phrase "distinct from his 
own" is inserted to cover the case in which some inlets are also outlets, 
and in which it is reasonable to suppose that an idle terminal that is 
both an inlet and an outlet does not attempt to call itself. 
We therefore make these two probabilistic assumptions: 

(a) Holding-times of calls are mutually independent random varia- 
bles, each with the negative exponential distribution of unit mean. 

(b) If at time / the network is in a state x in which at least one member 
of the inlet-outlet, pair (u,v) el X & is idle (that is, one of u or v is not 
involved in a call in progress), the time elapsing from I until a call 
between u and v is attempted is a random variable having a negative 
exponential distribution with a mean 1/X, X > 0. For different choices 
(u,v) and different occasions /, these times are all mutually independent 
and also independent of the call holding times. 

These assumptions can be rendered in the informal terminology of 
"rates" as follows: 

(i) The hang-up rate per call in progress is unity. 

(ii) The calling-rate between an idle inlet u (outlet v) and an arbi- 
trary outlet v (inlet a) with u j* u is X > 0. 

Assumptions (a) and (b) provide all the "randomness" needed to 
construct our models. The choice of a unit hang-up rate merely means 
that the mean holding-time is being used as the unit of time, so that 
only the one parameter X need be specified. 

v. OPERATION 

To complete the description of the traffic models to be analyzed we 
must indicate how the network is operated. Since in the present work 
we are taking into account only the network configuration, and omitting 
consideration of the control unit, it suffices to describe how calls to busy 
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terminals are handled, how blocked calls are treated, and how routes 
or paths through the network are chosen. 

It will be assumed that attempted calls to busy terminals are rejected, 
and have no effect on the state of the system ; similarly, blocked attempts 
to call an idle terminal are refused, with no change in the state of the 
system. All successful attempts to place a call are completed instantly, 
with some choice of route. 

To describe how routes are assigned to calls, we introduce a routing 
matrix R = {r xy ), with the following properties: for each x let U x be 
the partition of A x induced by the equivalence relation of "having the 
same calls up," or satisfying the same "assignment" (of inlets to out- 
lets) ; then for each Y c U z , r xy for y e Y is a probability distribution 
over Y; in all other cases r xy = 0. 

The interpretation of the routing matrix R is this: any Y e U x repre- 
sents all the ways in which a particular call c not blocked in x (between 
an inlet idle in x and an outlet idle in x) could be completed when the 
network is in state x; for y e Y, r xy is the chance that if this call c is 
attempted, it will be routed through the network so as to take the 
system to state y. That is, we assume that if c is attempted in x, then 
a state y is drawn at random from Y with probability r xy , independently 
eacli time c is attempted in x; the state y so chosen indicates the route c 
is assigned. The distribution or probability \r xy , y e Y\ thus indicates 
how the calling-rate X due to the call c is to be spread over the possible 
ways of putting up the call c. It is apparent that 

£ r *i/ = number of calls which can actually be put up in state x 

= s(x), ("successes" in x), 

the second equality denning s( • ) on S. This account of the method of 
routing completes the description of the traffic models to be studied. 

VI. TRANSITION RATES 

For the purpose of defining a Markov stochastic process it is conveni- 
ent and customary to collect the probabilistic and operational assump- 
tions introduced above in a matrix Q = (q xy ) of transition rates, here 
given by 

f i y * b x 

\r xy y cA x 

— I .r I — \s(x) y = x 
otherwise. 
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The number q xy , for x ^ y, has the usual interpretation that if the 
system is in state x, there is a chance 

q xy h + o(h) 

that it will move to y in the next interval of time of length h, as h — > 0. 
Similarly 

1 — q xx h + o(h) 

is the probability that the system will stay in x throughout the next 
interval of time of length h, as h — > 

VII. MARKOV PROCESSES 

In terms of the transition rate matrix Q it is possible to define a 
stationary Markov stochastic process {x t , — °o < t < +<»} taking 
values on the set S of states. The matrix P (t) of transition probabilities 

Px y (t) = Pr{.r t = y \ x = x} 

of x t satisfies the equations of Kolmogorov 

j t P(t) =QP(t) = P(t)Q, 



P(0) = I, 

and is given formally by the formula 

P(t) = exp tQ. 

Theorem 1: There exists a decomposition of the set S of states into a 
transient set F and a single ergodic set S — F containing the zero state: 
members of F have the property 

lim Pxy(t) =0 y e F, x c S; 

t-ao 

on S — F there is a unique stationary (or equilibrium) distribution 
{p x , x e S — F\ such that 

lim pxy(t) = p y > y e S — F,x € S 

t-00 

X PxPxv(t) = p v y e S - F, all t 

xiS-F 

2 qxvPx =0 y € S - F. 

xeS—F 

Proof: The existence of the unique ergodic set S — F follows from 
the fact that the zero state is accessible from every other state by hang- 
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ups. The existence and character of the limit of p xv {t) as t — > °o is a 
consequence of exercise 19, p. 436 of Feller, 4 i.e., of the fact that the 
characteristic values r of Q satisfy r = or Re (r) < 0. (See also Bell- 
man, 5 p. 294.) 

To prove the uniqueness of p, suppose that q is a different probability 
vector on S — F that also satisfies the "equilibrium" condition 

2 <Z*«<Z* = y € S — F. 

xiS—F 

Then by Kolmogorov's equation 

-r. X) gsPxuti) = H q*qxzPzy(t) = 0. 

ttl Xt8—F X,ze8—F 

Integrating from to I, and using P(0) = /, we find 
X) QxVxy(t) = q v y e S - F. 

XfS—F 

Since £ — F is the only ergodic set, the left-hand side approaches p v as 
I — > oo . Hence p = q. 

It is convenient to extend the dimension of p to | S \ by adding zero 
components for states in F, so that p xy {t) — » p v ^ for all x,y e S. 
The consideration of the transient set F is not just a mathematical fillip, 
since a "good" routing rule R may explicitly make certain "bad" 
states unreachable from the zero state, and thus place them in F to good 
purpose. 

In the notation of Halmos, 6 p. 65, the stationary probability vector 
satisfies the equilibrium condition 

Qp = 0. 

This is the classical equation of state, or equation of statistical equilib- 
rium, familiar in traffic theory. For our process Xt it takes on the rather 
simple form 

[| X | + \s(x)]p x = X Pv + * £ Pv r v* , x € S - 

ytA x yiB x 

The left-hand side represents the average rate of exits from x, while 
the right-hand side is the average rate of entrances into x, in equilibrium. 
We define 

p k = Zpx = Pr{L,}. 

|a:|=fc 

Lemma 1 : For 1 ^ k ^ w = max | x \ 

xeS 

kp k = X ^ p x s(x). 



MARKOV PROCESSES 2805 

Proof: From the statistical equilibrium equation for x = we obtain 
Ep« = Xs(0)p , 

VtA 

which is Lemma 1 for k = 1 . Assume that the lemma holds for a given 
k ^ 1. Summing the statistical equilibrium equations over x e L k we 
find 

kp k + X 2 s(&)px = E £ P« + A I] X) 7VV* . 

s«£i *«Ljfc y*A x xiL/c ytll x 

The second sum on the right is the same as 
and by definition, 






H r yx = s(y). 

XtAy 

H^nce (induction hypothesis) the second sum equals kpk . It is easy to 
see that in the first sum on the right each p y is counted exactly | y \ times, 
i.e., (k + 1) times, since for a given y e L k +i there are exactly (k + 1) 
elements x e L k for which y e A x . Thus the first sum is 

(fc+ 1) E Pu = (*+ Dp*+i 

and the Lemma follows by induction. This result could also be obtained 
from the general observation that the statistical equilibrium equations 
are equivalent to the principle that for any set X of states the average 
rate of exits from X equals the average rate of entrances into X. (See 
Morris and Wolman. 7 ) 

VIII. PROBABILITY OF BLOCKING 

The fraction of calls that are refused because they are blocked, or the 
probability of blocking, is a quantity of particular interest to traffic 
engineers; they use it to assess the grade of service provided by an operat- 
ing connecting network. The rigorous theoretical calculation of blocking 
probabilities has long been an outstanding problem of traffic theory. 
This problem is outstanding in both senses of the word: it is conspicuous, 
and it is unsolved. In fact, not even the definition (let alone the calcula- 
tion) of the probability of blocking has received adequate treatment; 
for example, the otherwise monumental treatise of R. Syski 8 does not 
give a general account of blocking probability. 

Since it is desirable to have a close connection between theoretical 
quantities and their physical meanings in terms of measurements, we 
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shall approach the study of blocking probabilities by asking how these 
probabilities might be measured "in the field." The most natural method 
of measuring the fraction of blocked attempts seems to be this: to the 
control unit of the connecting system under consideration we attach 
two counters; the first will count up one unit every time an attempted 
call is blocked, and the second will register one unit every time a call 
is attempted; the ratio of the reading of the first counter to that of the 
second should, after a long time during which the system's parameters 
remain constant, be an approximate measure of the fraction of blocked 
attempts. For mathematical convenience, one can then define the prob- 
ability of blocking to be the limit (as time increases without end) of this 
ratio of the counter readings. This mathematical definition was first 
proposed by S. P. Lloyd, although, of course, the ratio has been the 
practical definition for 50 years, being the "peg count and overflow 

ratio." 

A precise mathematical version of this measurement procedure can be 
given as follows: on the same sample space as that of the process ,r. t 
that describes the operating network, we define two additional stochastic 
processes {b(0, ^ 0} and {a(t), t ^ 0} by the (respective) conditions 

b(t) = number of blocked attempted calls in (0,fl, 

a(t) = number of attempted calls in (0,t\. 

These stochastic processes are the mathematical analogs of the counter 
readings. It is reasonable to use the limit 

r 6(0 
hm —F7\ 

of the ratio of b( • ) to a( •) as a mathematical definition of the prob- 
ability of blocking, provided that the limit exists in a suitable sense. 
We show that this limit exists and is constant with probability one, 
and we give a formula for it. 

Theorem 2: The ■probability of blocking b, defined by 

b = hm.-^-, 
t-**> a(t) 

exists and is constant with probability one; its almost sure value is 
r _ \V, Pj_ _ ^a 



(p, °0 X) p* a * ' 



MARKOV PROCESSES 2807 

where p is the vector of stationary probabilities, and 

/3* = number of idle inlet-outlet pairs that are blocked in state x, 

a x = number of idle inlet-outlet pairs in state x. 

Proof: It can be seen that a(t) and 6(0 can be written as sums over 
S, 

a(t) = £ o,(0 

xtS 

xtS 

where 

o z (0 = number of attempted calls made in (0,t] with the system 
in state x, 

b x (t) = number of blocked attempts made in (0,/] with the system 
in state x. 

Now a blocked attempt occuring at an epoch u such that x u = x does 
not change the state of the system. Such an epoch u is a regeneration 
point of the process x t . A successful attempt occurring at an epoch u 
at which :r„ = x does change the state of the system. The time interval 
from u back to the last previous epoch v at which a successful attempt 
occurred in state x, however, is independent of the behavior of x t for 
/ > u; it depends only on the fact that the system left x by adding a 
new call, not on what new call it was, nor on where into A x x t went as 
this new call was completed. This can be seen as follows: we have 

u — v — r — v + u — T 

where t is the epoch at which x was last entered prior to u. Now t — v 
is independent of x t for / > r if .iv+o is known to be .r, because x t is a 
Markov process. 

Let U be an event measurable on j.r, , t > u}. Then 

Pr { U and u — t ^ n \ x T +o = x } 

= Pr{« - r ^ M I a- T+0 = x] £ ^\ Pr [U | .r„ +0 = y], 
where 

Pr(« - r S „ | ,v + „ = ,) = t ( If I V" ^*> 

7=1 \\ x I + \s(x)/ I x | + \s(x) 

(»-Dl * 



•'u 
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Thus the time intervals ft , ft , • ■ ■ elapsing between successive blocked 
attempts in state x, and those a x , a 2 , • • • elapsing between successive 
attempts in state x, both form sequences of mutually independent, and 
except possibly for the first elements ft and «i , identically distributed 
random variables. That is, the elements of each sequence are mutually 
independent, but the sequences are not independent since one consists 
of partial sums over blocks of the other. 

Both these sequences can be studied, then, in terms of a sequence 
.ii , Xt , • • • of mutually independent random variables, all (except 
possibly X\ ) identically distributed. We define for t ^ and k ^ 

So = 

n 

<S n = ]C Xi , Xi = cti or ft 

i = 1 

n(t) = k if and only if S k ^ t < Sk+i , 

n(t) = a.(0 or b x (t). 

It is now straightforward to show that r ! w(0 approaches a limit with 
probability one, and to find the limit. Let us put, for t > Si 

n(l) = n(t) S„ U ) 
t S n (t) t 

The first factor converges to E~ l {xt} with probability one, by the law of 
large numbers. The local suprema of 

t - S„u 



(0 



t 



for t > Si occur at the points 

t = S k k = 1, 2, 
and have the values 



•t* __ k_ Xk 

Sk Sk k 



k = 1, 2, 



Again, the first factor converges to E~ l {x 2 ] with probability one by the 
law of large numbers. Since E{x 2 ] < », and [x k , k ^ 2} are identically 
distributed, 

go °0 

E Pr{-^ > &) = E Pr{a: a > ek\ < *, 

k=2 *-a 
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and it follows from the Borel-Cantelli lemma that for any e > 

Prjxfc > ek for infinitely many values of A* ^ 2j = 0. 

Hence Xh = o(k) as k — > » , with probability one, and with the same 
probability, 

^>->l as *_>«,. 

It follows that with probability one, 

lim t~ ajt) = E~~ J time interval between successive attempted calls 

in x], 
lim f'bAt) = iT'jtime interval between successive blocked at- 
tempted calls in x\ . 
Furthermore (cf. Ref. 11, p. 247, equation (1.2) and p. 249) 

-j E{b x {l) | .r = ?/} = \p U x(t)0x — * \pxPz as t — > co. 

However, by Feller's renewal theorem (cf. Kef. 11, p. 240), we know 
that 



lim t E[b x (t)\ Xo = y) = A'" '{time interval between successive 



l-l ETC I. /j\l .. ..) I.l- I I 

/ ' 

blocked attempted calls in x\ . 



Hence, with probability one, 

t~ b x (t) — > \p x (3 x as t — * oo. 
A similar argument shows that with probability one 

I a x (t) — » ^p x a x as t — > co 
and completes the proof of Theorem 2. 

IX. A BASIC FORMULA 

Engineers have recognized (at least) four quantities as significant 
for the study and design of connecting networks carrying random traffic. 
These are the calling rate, the average load carried, the variance of the 
load carried, and the probability of blocking. In our model these quanti- 
ties are given respectively by 
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X = calling rate per idle inlet-outlet pair 

m = X I x I P* — average number of calls in progress 

xiS 

a = 2 (I 3 I - m )Vx 
x«S 

& = (p,P)/(p,a). 

It is natural to ask whether there exist any systematic relationships 
between these quantities, or between these and (possibly) other simple 
parameters of the network under study. Such relationships would be 
particularly useful and significant if they were largely independent of 
the structure or configuration of the connecting network, and were valid 
either for all networks or for large classes of them. We shall show that 
there often exists a simple algebraic relation among X, m, a 2 , and 6. 
Its exact form depends on which inlets are also outlets. First we prove 

Theorem 3: The probability b of blocking can be written as 

b - 1 -r-^ (1) 

xeS 

or, in words, as 

average load carried 
(calling rate per idle) X (average number of idle pairs) 

Proof: In equilibrium, the average rate of successful attempts must 
equal the average rate of hangups. Hence, intuitively, 

X 2 Pxs(x) = J2\ x \p x = m. (2) 

xtS xtS 

Since (i x = a x — s(x), the result follows from Theorem 1. The actual 
validity of the identity (2) can be inferred from Lemma 1, by summation 
on k. 

Formula ( 1 ) , rewritten in the form 

average load carried 
average rate of attempts ' 

should be viewed as a direct generalization of Erlang's classical loss 
formula for c trunks, blocked calls cleared, and calls arising in a Poisson 
process of intensity a > 0. In that case the probability of loss is 

c 

a 

Ei(c,a) = -7—- , 
■A a 
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and it can be seen that 

r;; 



E^ 



1 - Ei(c,a) = 

E- 



= j=i il 

77 

average number of busy trunks 
total calling rate 

To exhibit useful special cases of the general formula ( 1 ) of Theorem 
3, we introduce a partial classification of connecting networks. A net- 
work is called one-sided if / = ft, i.e., if all inlets are also outlets; a net- 
work is two-sided if I H ft = <£, i.e., if no inlet is an outlet. 

Corollary 1: For a one-sided network of T terminals 

o = l- 1 2m 



X (T - 2m) 2 - (T - 2m) + 4a 2 ' 

Proof: For the one-sided network in question, we have / = ft, 1 1 \ = 
ft | = T, and so 

'T - 2 | x 

2 

E 7>,«x - UT 2 - C2T - l)2m - T + 4m 2 + 4<r 2 }. 

Corollary 2: For a two-sided network icith M terminals on one side and 
N on the other 

b = i - ! 



X (M - m) (N - m) + a 2 ' 
Proof: It is clear that in this case 

a x = (M - \x\)(N - \x |) 

so that 

E Px«* = (M - m)(N - m) + a 2 . 

xeS 

Each of the foregoing corollaries exhibits an explicit algebraic rela- 
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tionship between X, m, a, and b, based only on the one- or two-sidedness 
of the network. 

The preceding corollaries can be used to show that in a large system, 
the numerical value of the constant X will be small — indeed, of the order 
of the reciprocal of the number of inlets and outlets. This can be seen 
by the following heuristic argument, carried out for a one-sided network 
with T terminals: suppose that each terminal carries q (0 ^ q < 1) 
erlangs and that the blocking probability b is so small that we can ignore 
it and set 

h ,_1 ?w = Q 

X (T - 2m) 2 - (T - 2m) + 4a 2 

Since the network is one-sided, any load carried by one terminal is 
also carried by some other terminal, and so 



whence 



qT = 2m 



x-i q 



T ,-, ^2 (1-5) ,4 



■i ■ 



a 



Because 



and 



(i -«) -^v^ + ^ 



<r 2 = £p»(l* I - w ) 5 

xtS 



mi 

(\x\ - m) 2 ^ -T-, 



i2 

4 
we have ^ 4<x 2 /T 2 ^ 1, and so 



const. 



with 



q < const. < 



i + (1 - qY = = (1 - 3) a - r-*(l - g) " 

X. SOLUTION OF THE EQUATIONS OF STATISTICAL EQUILIBRIUM 

So far, we have shown that the theoretical determination of the 
blocking probability b reduces to that of the stationary vector p or, 
in many cases, to that of the mean m and variance a of the carried 
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load. In either case, some knowledge of p is required. Most of the rest 
of this paper, therefore, is devoted to the calculation of p and to the 
study of its properties. 

In the past, the application of A. K. Erlang's very natural method 
of "statistical equilibrium" to congestion in connecting networks has 
been visited by the curse of dimensionality, that is, by the extremely 
large number | *S [ of equations comprised in the stationarity condition 
Qp = 0. This difficulty has not only put explicit solutions apparently 
out of the question; it has even made it effectively impossible to reach a 
reliable qualitative idea of the dependence of the state probabilities 
\p x , x e S\ on the structure of the network and on the method of routing. 

To be sure, it has always been possible in principle to solve Qp = 
by successive elimination of unknowns; however, when the dimension 
of p is of order 10 4 or so, this remark is hardly helpful. Since successive 
elimination can be used to solve Qp = for any "ergodic" transition 
rate matrix Q, it neither elucidates nor uses any of the special features 
of the matrices Q that arise in problems of congestion in networks. 
Thus, even were it algebraically feasible, the method of successive 
elimination treats our matrices Q as indistinguishable from other matrices 
possessing a zero characteristic value. 

We shall give several explicit solutions of the equilibrium equations. 
One is based on purely algebraic considerations, and the others largely 
on combinatory and probabilistic notions. Because of the generality 
of our model with respect to network structure, the formulas appearing 
in the solutions are necessarily rather complex. Except in simple cases, 
they cannot be regarded as giving a final (or even a working) solution 
to the problem of calculating equilibrium probabilities. Nevertheless, 
they expose the mathematical structure of the problem and provide a 
badly needed starting point for well grounded approximations. For only 
after one has studied and understood this structure can he seriously 
think about throwing some of it away in approximations. 

To describe the solutions in full detail, we need various preliminary 
definitions and conventions. 

It will be shown in a later paper 9 that the minimum value of the 
blocking probability b is achieved by a routing matrix R consisting 
entirely of zeros and ones, i.e., by a deterministic ride. So it is assumed 
henceforth that It has only zeros or ones for entries. 

A path on S of length I ^ is any ordered sequence .r , X\ , • • • , x\ 
of (I + 1) elements of »S'. A lower case pi, ir, will be used as a symbol 
lor a generic path on S, and we write 

ir = {x ,Zi ,-• ■ • ,xi], I = l(ir) 
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to indicate that % is a path of length Z(tt) consisting of .r , .ri , • • • , x t 
in that order. Note that paths of length zero are countenanced. A path 
ir is a loop if 

x = Xi, 

and also 

Xi ^ Xj 

whenever < i < j ^ l(r). A loop of length zero is a path of length 
zero. If x = [x n , xi, • • • , .To} is a loop, each element .t , X\ , • • • etc. 
will be spoken of as being on w. 

The elements x and y of S are called adjacent in the graph of ( S, ^ ) , 
i.e., in the state diagram, if one of the following equivalent conditions 
holds : 

(») x covers y or y covers x 
(ii) y e A x or x e A u 
(Hi) x and y differ by exactly one call in progress. 

A path on S is called continuous if successive elements of the path are 
adjacent. 

In order that x t have positive probability of following a path t, it is 
not enough that t be continuous. For evidently the action of the routing 
matrix R (assumed to consist solely of zeros and ones) is to prohibit 
certain paths on S as (parts of) possible realizations of the process 
x t . Here "possible" of course means "having positive probability." 
There exists then a class of those paths that are permitted by R, definable 
in several ways. One such way is as follows: A path r = \x , x x , ■ • ■ Xi] 
on S is permitted by R if for each i in the range 1 ^ i ^ /, 

Xi e B Xi _ x or r Xi _ lXi = 1. 

The set of paths permitted by R is denoted by P. 
With X a subset of S, 

perm(X) 

will denote the set of all permutations of X, i.e., one-to-one maps of X 
onto itself. We let 

2/1,2/2, • • • V\a\ 

be an arbitrary simple ordering of S, and we define the ordinal number 
w(x) of a state x e S by the condition 

w(.r) = n if and only if x = y n , n — 1, 2, • • • , | S |. 
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For each m,n in the region 1 ^ m,n ^ | S |, we define a function f „,„( • ) 
on the domain 1 ^ i ^ | S | by the condition 

1 ^ i < min( m,n) 



fm n (t) = S 



i = fli or t'sfl 

2—1 min (m,n) < i < max (m,n) 

t — 2 max (m,n) < i ^ | S |. 



We observe that f „,„( • ) has an inverse for each m and n. Now let y>( ■ ) 
be a permutation of the set of states with the with and the nth removed ; 
then 

* -» W-Wvr-^w)]) * = 1. 2 . • • • . I s I " 2 

defines the permutation a mn (<p) associated with <p. Also, sgn a„,„(<p) is 
+ 1 or —1 according as the permutation a mn (<p) is even or odd. 
The "hang-up" matrix H = (h xy ) is defined by the condition 

fl if y*B x 
h*v = 

(0 otherwise. 

Let .r and z be states, and suppose that x = (.r , • • • , xi) is a path 
in P beginning at z and ending at x, so that x = z and xi = x. Suppose 
also that the trajectory represented by x contains m new calls, i.e., 
there are exactly m values of i in the range 1 ^ i ^ I such that 

Xi e A xi _j . 

Since x starts at z, in which | z | calls are in progress, and ends up at x, 
in which there are | x \ calls in progress, it is evident that 

l(ir) = 2m + | z | — | x |. 

The set of paths which start at a state z, never return to z, and end 
up at x 9* z, is denoted by 

K !X . 

Thus x belongs to K n if and only if x = z, x t j± z for < i ^ 1(t), 
and Xi = x. 

Let x = j.r , X\ , • • • , •«/) be a path on *S, and let/(x,- ) be a function 
defined for .r , Xi , • • • , Xi . In terms of /(ir, • ) and x, we define a product 
along the path x by the expression 

n /u, »i). 

i=i 

T=|T ,I,...-,I|) 
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It is convenient to abbreviate this product by the readily understand- 
able expression 

xtv 

111 the special case that /(ay ) has the form 

f(ir,Xi) = h(xi-i , Xi), i = 1, • • • , I 
we abbreviate the product by 

XtV 

The notation p- is supposed to represent the predecessor of an element 
in 7r. 

The first and simplest solution of the equilibrium equation Qp = 
to be given is based on an observation made by I. W. Sandberg, namely, 
that det(Q), and hence det(Q'), are zero, so that Q'adj(Q') = 0, and 
thus columns of the matrix of cofactors of Q should give solutions of 
Qp = 0. The author has not succeeded in elucidating the probabilistic 
significance of these simple algebraic facts. It will be seen later that the 
other solutions to be given are, on the other hand, natural, plausible, 
or even obvious from a probabilistic viewpoint, but are algebraically 
involved. 

Theorem 4: Let m be an integer in the range 1 ^ m ^ | S |. An unnor- 
malized nonnegative solution p of Qp = is given by 

Plln = (_i)l»l -*+-+■ 2 sgn «„,„(*>) 

•ft perm (S—[v m ,u n )) 

II (~ I Z I - XS(*)) II {KM + to,<«))- 
<p(z)=* ¥>(z)t<S 

Proof: Since det(Q) = 0, it follows that det(Q') = 0, the prime indi- 
cating the transposed matrix. Hence (Birkhoff and Mac Lane, 10 p. 290) 
no matter what ordering of S is used. 

Q'adj(Q') = 0, 

where 'adj' denotes the adjoint matrix, i.e., the transposed matrix of 
cofactors. Let C = (c xu ) be the matrix of cofactors of Q corresponding 
to the ordering iji , y» , • • • ,y\ & \ of S, and suppose that the entries of Q 
are also arranged according to this ordering. Then 

C = adj(Q') 

and we find that 

2 QzJizy = 0. 
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Thus any column of the matrix C of cofactors of Q gives a solution of 
the equilibrium equations. It follows from a result of W. Ledermann 
( Bellman, 5 p. 294, exercise 10) that 

(-i) l ""V* ^ o. 

We see that all the cofactors e iy have the same sign, and each column of 
the matrix (' yields a nonnegative solution of Qp = 0. Hence all columns 
are proportional, because there is only one nonnegative solution, up to 
normalization. The theorem follows from the standard formula for a 
cofactor as a determinant. 

Theorem 5: If z e S is any slate, then an unnormalized solution of the 
statistical equilibrium equations Qp = is given by 

p>= 1 
and for x 9* z, 

l(*) +\x\-\z\ , 

px= l x 5 n 



Proof: The formula given can be verified by direct substitution in the 
equations 

[\S(.V) + | X \]p x = E P» + ^ Z Pu r v* . •'' e (S - 

Convergence of the infinite sum will follow from our Theorem 7 and 
exercise 19, p. 378 of Feller. 1 

XI. STATIONARY PROBABILITY MEASURES FOR ERGODIC MARKOV PROCESSES 

Tn order to shed light on Theorem 5 (and also to prove it by a prob- 
abilistic argument) we shall consider in this section the general problem 
of calculating the stationary probability measure of an ergodic contin- 
uous parameter Markov process on a finite number of states. Our object 
is to give an explicit formula for the measure in terms of the transition 
rate matrix. Again, it is needless to mention that a formula of such 
generality must be fairly complex. Applied to familiar Markov processes 
whose stationary measures are well known, the formula to be given 
yields some unexpected combinatory identities, not pursued here. 

We shall now use the notations .r, , S, Q, and P( ■) to describe an 
arbitrary Markov stochastic process x t in continuous time, taking values 
in a finite set S of states with transition rate matrix Q = (q iy ) and tran- 
sition probability matrices Pit) = (p xy (t)), t real. It is assumed that 
there is a single ergodic class of states. Such a general interpretation of 
notations already introduced (for specific processes describing traffic in 
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connecting networks) is made to avoid defining new terminology; it is 
made in this section only, and should cause no confusion. 

If z is a state, a return to z is defined to be an epoch of time at which 
x t reaches z, i.e., u is a return to z if for some e > 0, x% ^ z for u — e. 
< t < u and Xt = z for u < t < u + e. A departure from z is an epoch 
of time at which x t leaves z, i.e., u is a departure from z if for some e 
> 0, x t = z for u — e < t < u and x t 7^ z for u < t < u . -\- e. A 
return time to z is a period of time elapsing between a departure from 
z and the next return to z. We set, for t ^ 0, 

Hz(t) = E{ number of returns to z in (0,t] | .r = z\ 

n z = E{ return time to z) 

q z = —q zz = E~ x { length of a stay in z) 

The notation H z { • ) has been chosen because the defined quantity has 
an obvious resemblance to the classical renewal function. (See Smith. ) 

There is a simple relationship between the equilibrium probability of 
a state x, and the quantities n x and q z ; this is expressed in the next 
theorem which, though probably familiar, is included for completeness. 

Theorem 6: For x e $, p x = [1 + Qxtixf 1 . 

Proof: The transition probability p xx (t) approaches p x as t — > oo, 
and is expressible as 

p xx (t) = e~ qxt + I ' e-" At - u) dH x (u). 
•'o 

Since stays in x and returns to x are all mutually independent, the stays 
being identically distributed, and the returns also, the renewal theorem 
[Smith, 11 p. 247, formula (1.3)] implies that the right side approaches 



f 



1 



^/interval between successive! 1 + q x ti x 
\ returns to x J 

Thus p x can be calculated from /x x where 

fj. x = I u dPr{ return time to £ ^ u) 
Jo 

= I Pr (return time to x > u] du. 

J o 

For our purposes it is convenient to approach the calculation of p x 
in a slightly different way. Let z be any state, and let x be a state dis- 
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tinct from z, z j* x. Define q zx (t) in t ^ to be the probability that if 
the stochastic process start at z at time zero, it be at x at time t without 
having returned to z. Thus 

9«(0 = Pr{.T { = x and (epoch of first return to z) > t\ x = z). 

For convenience, we set g«(J) = in t ^ 0. 
Lemma 2: For z t* x, t ^ 0, 

p«*(0 = / Qzz(t - u) dH„(u). 

Proof: Let U , i = 1, 2, . . . . be the epoch of the «'th return to 2 in 
t > 0, and let Ai(t) be the event 

fa;* = x and f» ^ t < ti+i}. 

Then 

Pr{A<(0 \x = z} = / (? zx (i - u) dPr[U ^ w | .r = z). 

However (cf. Ref. 11, p. 251, formula (1.7)), 

CO 

H.(t) = £Pr{<* ^t\x = z} 

i=l 

and 

VM = EPr{iti(0 |*o = 2}. 

t=i 

The integration and the summation can be interchanged by the mono- 
tone convergence theorem, and the lemma follows. 
Lemma 3: For z ^ x, 



j* 00 

p x = ^—r 1 / q,x(u) du. 

1 4- a,u, Jn 



1 + qzVz "o 
Proof: The integral on the right exists, since 

/»cO 

/ Qzx(u) du = E {time spent in x between successive returns to z\ ^ y. z . 

The lemma follows from Lemma 2 and the renewal theorem. 
The matrix A is defined by the condition A = (a^) with 



Qxv 
2x 


x j± y 





x = y 
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It can be verified that A is a stochastic matrix, indeed, the one-step 
transition probability matrix of a Markov stochastic process {x n , n an 
integer} taking values on S; x n is a discrete-time analog of x t obtained 
by ignoring the lengths of time spent in a state. 
Lemma 4- For z 9^ x, 

, s . 1 -/number of arrivals at x between) 
Qzxiu) an = — jea , , ? • 

* q x [successive returns to z J 

Proof: The integral is the expected time spent in x between successive 
returns to z. Each stay in x has mean length l/q x , and the stays are 
independent of the rest of the trajectory followed. 

Lemma 5: For z 9^ x, 

„\ number of arrivals at x between\ 
"'(successive returns to z \ 

00 

= XI Pr{ar B = x and x, ?*■ z for 1 ^ j ^ n\x = z). 

n=l 

Proof: We remark that the expectation on the left is the same for 
both x t and x n . The lemma is then a special case of the theorem that if 
{Ai, i = 1, 2, . . .} are any events, then the expected number of A t 
that occur is 

EPrMa. 

1=1 

Lemma 6: 

/■CO 

fi g = 2 / Qzx(u) da. 

x J 

Proof: This is an immediate consequence of q lz ( ■ ) = and 

q zx (u) = 2? {time spent in x between successive returns to z\. 



f 

•In 



for z 7^ x. 

Lemma 7: Let x ^ z. Then 



Pr{rc„ = x and Xj ^ z for 1 ^ j ^ n \ x = z\ 

— Ob y* tt ^■ pv,h 

q z TtK zx ytw q v 
Proof: The event in question can occur in as many ways as there are 
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paths of length n in K zx . The probability that [xj , ^ j ^ ??) follow a 
path 7r from z to .r is 

9f rr Qpy.v 

Qz ytr q v 

the quotient in front correcting for the end points. 

Combining Theorem 6 with Lemmas 4, 5, 6, and 7, we obtain the 
following explicit formula for the stationary probabilities: 

Theorem 7: If x 5* z, then 

1 + qzfiz rtK !x ytx q y 



with 



and 



Qpv.y 



q-znz = z zn 

x^z r(K IX ytT q y 



1 
Vz = 



1 + qztiz 

We remark that Theorem 5 follows from the above if we choose 2=0 = 
zero state, omit normalization, and observe that only products along 
permitted paths (t e P) are nonzero. Theorem 7 is an analog for con- 
tinuous parameter processes of a theorem of Derman for Markov 
chains. 

XII. EXPANSION OF THE STATIONARY VECTOR p IN POWERS OF A 

We now turn to examining, in an elementary way, the analytical 
dependence of the state probabilities \p x , x « S\ on the calling rate A, 
on the structure of the network, and on the routing matrix R. It will 
be shown that the partial ordering ^ of the set S of states can be used 
to calculate the elements of p by expanding the ratios 

& x>0 

in powers of the traffic parameter X in a neighborhood of X = 0, and then 
determining the coefficients of this expansion from the structure of the 
network and the routing matrix by a recursive procedure. The solution 
so obtained is later (Section XV) extended to arbitrary real positive 
values of X by analytic continuation, and the coefficients are calculated. 



2822 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1963 

Our approach to studying the stationary probability vector p will be 
guided by these intuitive remarks: it is known that in various simple 
models (of connecting systems carrying random traffic with blocked 
calls refused) the probability that k calls be in existence is proportional 
to the frth power of a constant associated with the calling rate divided 
by k factorial. For example, in Erlang's model for c trunks with blocked 
calls cleared, the chance that k calls are in progress is proportional to 

&• 0ikSc 

where a is the calling rate. Note that the exponent of a is the number of 
calls in progress, i.e., the current difference between the cumulative 
number of new calls and that of hang-ups, assuming that the system 
started in the zero state. The factorial in the denominator is the number 
of orders in which the k calls in progress could all hang up, or alterna- 
tively, could all have arisen. 

The situation in our model is very similar. Each call still in progress 
required an event occurring at the rate X to put it in existence ; for each 
state x, there are exactly | x | ! orders in which the | x | calls in prog- 
ress in x could arise, or terminate. These circumstances suggest that for 
x > 0, p x might be of order X 1 x ' as X — > 0, and that the coefficient of X 1 x ' 
in p x might involve | x | ! in the denominator. These conjectures are 
true, and are the first step in the systematic calculation of p x by ex- 
pansion in powers of X, to be carried out in this section. 

We first record some analytical properties of p as preliminary results. 
Some of these results could be obtained as consequences of the basic 
solutions given in Section X. Most of the proofs to be given, however, 
are independent of Section X, and proceed by simple arguments from 
the equilibrium equation. 

When we need to view p x as a function of the parameter X, we write 
p x = Pi(X), x e S, or in vector form, p = p(X). 

Lemma 8: lim p x (\) = S x0 . 

Proof: Let x be a maximal state in the partial ordering ^ of the set 
S of all states. Then s(x) = 0, and 

I a |P*(X) = XS Pi/OK*. 

Since ^ Pi/(X) ^ 1 for all X > and all y e S, the lemma is true for 
maximal states. Assume, as a hypothesis of induction, that the lemma 
is true for all ij with | y \ ^ k + 1. Then for x e L k , k > 0, 

[ | x | + Xs(z)]p*(A) = £ p„(X) + X E VvWr VI , 
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and so px(X) — » as X — > 0. The proof is completed by observing that 
for each X > 0, 

Po(X) = 1 -Epx(X). 

i>0 

Lemma 9: For each x e S, p x is the restriction to real positive argument 
of a rational function p x { • ) of a complex variable y.. The function p x { • ) 
has no poles in a neighborhood of the half-line Re(/*) ^ 0, Im(/i) = 0, 
and an expansion 

p x (n + e) A m , v 

P0K.fi -J" €) m=0 

with real coefficients c m (x,\) is valid for Re(/i) ^ 0, Im(/x) = 0, and 
| e | small enough. 

Proof: The equation Qp = can be solved for a normalized (i.e., 
probability) vector p(\) by successive elimination or by use of Theorem 
4. Either procedure gives rise to an algebraic expression for p x (\), 
x e S. Let p x (n) be that rational function of a complex variable n de- 
fined by substituting n for X in this algebraic expression. Since ^ 
Px(X) ^ 1, Pi(m) has no poles in a neighborhood of the nonnegative 
real axis. To justify the expansion we show that p x ( ■ )/po( ■ ) is also 
analytic in that neighborhood. But this is immediate because by Lemma 
8, 

p*(X) -» 8 0x as X — > 0, 

and by Theorem 1, p (X) > for X ^ because the zero state belongs 
to the ergodic class S — F. 

Setting m = and e = X in Lemma 9, we obtain an expansion of 
p x /po in powers of the traffic parameter X, 

P*(X) 

Po(X) 



£ X m Cm (a-,0), 



valid for X small enough. 

Theorem 8: F<rr k > and x e L* 



and 



P* = S Px = 0(X*) as X — > 0, 

nit 



p, = Oi\ k ) as X ^0. 



Proof: We prove both results simultaneously by induction. By Lem- 
ma 8, the result is true for k = 0. Assume that it is true up through 
k — 1 ^ 0. From Lemma 1 and the induction hypothesis, we find 
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Pk = r E Pys(y) 

A- VfLk — l 

= 0(\ k ) as X -» 0. 

By Lemma 9, for X small enough p x can be written as a power series 
around X = 

p x = £ X m c m (.r,0). 

m=0 

Thus 

£ X m £ c m (.r,0) = p fc = 0(X*) as X -> 0. 

The first nonvanishing coefficient in the expansion on the left must be 
positive, else p fc < for X > small enough, which is impossible since 
Px(X) ^ for X > 0. Hence 

£ c (x,0) ^ 0. 

xtL k 

However, the first nonvanishing coefficient in the expansion of p x must 
also be positive, for the same reason as above, namely, that p x (X) ^ 
for X ^ 0. Thusc (:c,0) ^ 0. Hencept = 0(\ k ) as X — > implies c (.r,0) = 
0. We apply the same argument successively to show that for x e L k , 
the coefficients ci(.r,0), . . . , c k ~i(x,0) are all zero, and the theorem is 
proven. 

Theorem 9: For x > 

p x = po t^tt r* + o(X ') as X — > 
I x I ! 

where 

r x = (« |xl )ox 

= the 0,x entry of the | x | th power of the routing matrix R 

= the number of permitted strictly ascending paths from to x. 

Proof: The equation of statistical equilibrium that defines p is 

[ | x | + Xs(a-)]p* = £ Pv + X £ Wtm , x e S. 

yiA x V(B X 

For convenience, suppose that \x\ = k. We divide the equation by 
po , use Lemma 9 to expand the components of p/po in powers of X, and 
equate the coefficients of X* on each side of the equation. This gives 

kc k (x,0) + s(x)c k ^(x,0) = Ec*(2/,0) + £ c k -i(y,0)r yt . 

ytA z ytB z 
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By Theorem 8, Ck-i(x,0) = and Ck(y,0) = for y e A x . Therefore 
kck(xfl) = £ c k -i(yfi)r vt , 

V*B X 

or in general, with y the vector with components C\ y \(y,0), 
C\x\(x,0) = r-fS c M (y,0)r vx 

| * | VtB x 

= r- 1 c\v\(yfi)r v x 
I * I 

Iterating this relation | x | times, we find 

e w (x,0) = rA-,(^' x| 7).- 

Now it is easily seen that the y,x entry of J? is zero unless k = \ x | — 
1 1/ | , and in particular, if k = | x | , this entry is zero unless ?/ = 0. Thus 

C|.|(*,0) = pjp (« |x| )oxC (0,0), 

and it is obvious from the definition of the c m (y,0) that c (0,0) = 1. 

Theorem 10: Let the sequences {c m (x,Q), m ^ 0, x e S] be defined re- 
cursively by 

c,„(0,0) = 8 m0 

c„,(.r,0) = for ^ wi < | x \ 

and. x > 

c m(*,0) = ~p 

|rc|c m (a:,0) + s(x)c m -i(x,0) = £ c„(y,0) + £ c»^(y,0)f», 

/or m > | .-c | and x > 0. 
If for x > 

X < (lim sup | c m (x,0) \ lh ") ""' 

i/ten Z/te component p x of p is given by 

GO 

Px = PoJl X m c m (.r,0). 
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If 



llm\-l 



X < min (lim sup | c m (x,0) | m ) , 

x>0 m-*cc 

then the probability p Q of the zero state is determined by the normalization 
condition 2_, p x = I as 



Po = = • 

1+EZ A m C m (.T,0) 
x>0 m=0 

Proof: This result follows immediately from Lemma 9 and Theorem 9, 
using the standard formula for the radius of convergence of a power 
series. 

XIII. EXPANSION OF THE PROBABILITY OF BLOCKING IN POWERS OF X 

With a method of calculating equilibrium state probabilities for small 
X at hand (in principle, at least) we now show how the probability b of 
blocking can be calculated, to any desired degree of accuracy, by an 
expansion in powers of the traffic parameter X, assumed sufficiently 
small. In most connecting networks of practical interest, none of the 
states near the bottom of the state-diagram has any blocked calls, so 
that it is necessary for a state x to have certain minimum number of 
calls in progress before it can have any blocked idle pairs. To take ad- 
vantage of this situation in our calculation, we let 

n = least k such that some call is blocked in a state of Lk . 

Theorem 11: The probability b of blocking can be expanded in a power 
series in X in a neighborhood of X = 0; only terms of order higher than or 
equal to X" appear. 

Proof: From Theorem 2 we have, since /3 X = for | x \ < n, and 
c k (x,\) = for k < | x | , 

h = ^ — 



£ PxOix 



(3) 



X"E^' Z c n+j (x,0)/3 x n , . 

_ j=0 ng|a|gn+j _ A &{*) 

±\* Z cj(x,0)a x A(X) 

3=0 3^\x\ 
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Since the denominator is not zero in a neighborhood ofX = 0, & = &(X) 
is analytic there and can be expanded in powers of X. Up to terms of 
order X" +2 this expansion is 

, _ „ W) n+ i A(0)B'(0) - A'(0)B(0) 
A(0) "*" [A(0)] 2 

^_ .,«/A'(0)B'(0) -A"(0)£(0) 



2[A(0)] 2 

_ A / (0)A(0)B / (0) - A' 2 (0)B(0) 
[A(0)]« 

+ o(X" +2 ). 

The coefficients in the first two terms can be obtained by the following 
calculations : 

4(0) = E c (x,0)a x 

inso 

= c (0,0)a 
= «o , 
5(0) = E c„(.«-,0)/3, 

l*!gn 



= E c„(z,0)/3 a 

|x| = n 



n! x—. 
A'(0) = E dfoOK 

= E d(x,0)«. 

in=i 

= 2-/ r 0iar , 
XcL] 

B'(0) = E c, i+1 (.r,0)/3 x 

Ixl^n + l 
= E C w+ i(X,0)/S, + E Cn+^^OJjS, 



(/I 



-J-rv-. E rA + E c„+i(.r,0)/3 x . 

~T -U I xe^n+1 X'i-n 



The constants {ck+i(x,0), \ x \ = k} can be determined by the following 
recurrence, obtained from Theorem 10: 
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d(0,0) = 0, 

Our results can be put in a slightly more explicit form by expanding 
log b rather than b, and using the fact that A(-) and B(-), as denned 
by (3), are generating functions. We have 

log b = n log X + log B(X) - log A(X). 

Except for the systematic absence of factorials, the coefficients in the 
expansion of log B(\) are related to those in the expansion of B(X) as 
cumulants are to moments. Set 

bj = X) c n+ j(x,0)p x , j = 0, 1, . . . , 



so that 



«i = S c,-(&,0)a« , j = 0, 1, ... , 



B(X) = E^y, 



i=o 

A(x) = Ex^. 

i=o 
Then, by a standard formula (Riordan, 13 p. 37), 

Jog B(x) = E x'*,(&), 
/-o 

logA(X) = E4-W, 
i=o 

where for m = a or & (sequences) 



n (-l) k -\k- 1)! 



K n (u) = Z ("X) fcl • • • («.) " (/ci) ,... (/.J,' > 

with fc = fci + ^2 + ■ ■ • + fc„ , and the sum over all partitions of n, 
i.e., all solutions in nonnegative integers of k x + 2/c 2 + • • • + wfc„ = n. 

XIV. COMBINATORY INTERPRETATION AND CALCULATION OF THE CON- 
STANTS {c m (x,0), xtS,m ^ 0} 

We shall now evaluate the coefficients in the power series expansion of 
p around X = explicitly as sums of products on paths in S. Additional 
combinatory notions that enter this calculation are discussed first. 
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A path is said to contain a loop if it returns (one or more times) to a 
place where it has been previously. Thus -tr = {x , ■ • • , xi\ has a loop 
if there are integers i and j, ^ i < j ^ I, such that 

Xi = Xj . 

A circuit is a path that ends where it begins. Thus the generic path 
7r = (:r , . . . , xi] is a circuit if .r = .r* . A circuit is a loop if it contains 
no subcircuits, i.e., t is a loop if .r = Xj and i 9^ j implies 

Xi ^ Xj 

for any ^ i ^ I and < j < I. 

A circuit of length two is of necessity a loop. Furthermore, the cir- 
cuits of length two on S can be partitioned into two classes according 
to the direction in which they are traversed. Each such loop can be 
thought of as obtained either by first adding a new call and then re- 
moving that same call, or by removing a call and then replacing that 
same call. Thus if ir = \x , x t , .t 2 } is a loop of length two on S, then 

•Co = %2 
and either 

x-2 = Xo e B Xl 
or 

.r 2 = .r e A XI 

and, of course, not both. In the first instance we say that it is of the 
first kind. Thus a loop of the first kind is a path t of the form \x,y,x) 
with y t A x , i.e., it is a trajectory in S obtained by starting at a state x, 
adding a new call to go to a state y, and then removing that very same 
call to return to x. 

Tor a path t = [x , . . ■ , :i'i\ and a state x we say that x is on ir if x 
is one of .r , X\ , . . . , Xi . If x is on ir, we say that a loop of the first 
kind on t ends at .i- if for some i in the range 2 ^ i ^ I, 

Xi = .r,_ 2 = x 

and 

xt-i e A x , 

that is, the subpath }.r,_ 2 , .r,-_i , .?,-} is a loop of the first kind, and Xi is x. 
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With ic and x as above we define 

(\ x | , if x is on v and a loop of the first] 
g(w,x) = \ kind on -k ends at x 

{ 1, otherwise, 

and we denote by v(ir) the total number of loops of the first kind con- 
tained in 7r. 

With these combinatory preliminaries behind us, we are ready to 

prove 

Theorem 12: The coefficients \c m (x,0), x e S, m ^ 0} are given by 



c„,(0,0) = 8 m0 , 



and for x > 0, 



c„(. c ,o)= E (-d""> n^^rr (4) 

2(ir)=2m-|x| 

Before proving the theorem it is probably helpful to state it in words, 
thus: To calculate c m (x,0), consider all the paths w that are permitted 
by R, start at 0, never return to zero, end up at x, and have length 
2m — | x | (i.e., consist of m new calls and m — \x \ hangups) ; along 
each such path t take the product of the reciprocals of the numbers of 
calls in progress in the states traversed by w, omitting states at which a 
loop of the first kind ends; weight the product positive or negative 
according as tt has an even or an odd number of loops of the first kind ; 
add up all the weighted products. 

Proof of Theorem 12: We already know that c m (x,0) = 8 w0 and that 
c m (x,0) = for x > and m < \x\ . The latter residt is consistent with 
Theorem 12 because no path from can reach x in fewer than | x | 
steps. Consider then the case m - \ x \ ^ 0. Any path ?r from to x 
of length 2?n — \x \ = m consists entirely of new calls, and for such 
a ir 

tt g(*;y) = _L 

yh \y\ \x\V 

The number of such paths, summed over in (4), is easily seen to be r x , 
the number of permitted strictly ascending paths from to x. Thus for 
m = I x I , (4) states that 



Cm(x,0) = 7-^ 



as was proven in Theorem 9. 
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The remainder of the proof is by upward induction on m and finite 
downward induction on x, using the recurrence formula 

| x | c m (x,0) + s(aOc«_i(a;,0) = X c m (yfi) + X) c m -i(y,0)r yx , 

v*A x y(B x 

given by Theorem 10. The starting step of the induction is the fact that 
formula (4) holds for x e S and m such that 

< | x | ^ m ^ 1. 

This is a consequence of the fact, already proven, that (4) holds for 
\ x \ = m. 

Let us assume, as a hypothesis of induction, that the theorem holds 
for all x e S and m such that 

< | x | ^ m ^ k. (5) 

We shall prove from this, by downward induction on x, that it also 
holds for x e S and m such that 

< | x | ^ m = k + 1. 

This last condition exactly describes the new cases covered in extend- 
ing (5) tofc 4- 1. 

Where ir is a path, we use the natural notation wx to denote the path 
obtained from ir by adding x to t as a new ultimate element, assuming 
that x is adjacent to the last element of r. We now observe that if irx 
is a path that does not end in a loop of the first kind, then g(irx,x) = 1, 
and so 

ilrx \z\ | X | 7ei | 2 | ' (6) 

v(ttx) = v(t.) 

A state x is maximal in the partial ordering ^ if no new calls can be 
put up in x, for whatever reason. If x is maximal, then A x is empty and 
s(x) = 0. A state x is maximal in (a set) X £ S if x ^ y for every?/ e X, 
and x e X. 

Let 0^ | a; | ^ m — fc + 1 and suppose first that x is maximal. Then 

c„,(.t,0) = i — , 2 c m -i(y,0)r vx . 

No path ending at a maximal state x can end in a loop of the first kind, 
and any such path must have a y e B x with r yx — 1 as a penultimate 
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element if it is to be a permitted path. Then clearly 
{*■ e P fl K 0x : 1(t) = 2m - \x\\ 

= U (tti-tt eP f\ K y 

V(B X 

and Z(t) = 2m — \x j — 1 and r tfa = 1}. 

Let now y e B x , r e P f) K 0u , l(r) = 2m — \x\ — 1, and r yx = 1. 
Then irx satisfies g(irx,x) = 1 and also formula (6). Thus formula (4) 
holds for maximal x and ^ | x j ^ m = k + 1, by the hypothesis of 
induction. 

Next, consider states x that are maximal in the set 

[yt S.O ^ | x I ^ k + 1}. 

These are just the elements of Z*+i , i.e., the states x with | a: J — k + 1. 
Since we are assuming m = k 4- 1, the result (4) holds for these a; by 
Theorem 10. 

finally, assume as a hypothesis of downward induction (on | x \ ) 
that the result is true for y e S and m such that 

1 < j + 1 ^ | y I ^ m = /c + 1, 

and suppose that | x \ = j. Then 

cXxfi) = r^-. Z [c m (?/,0) - r xy Cm-Axfi)] + qS Cm-iiy&ryx. 

If 7r is a path on S the notation pe(ir) denotes the penultimate ele- 
ment of tt, i.e., pe(x) = zi-\ for t = {20, Si , • • • , *i}. The notation 
ape(7r) denotes the antepenultimate element of ir, i.e., for ir = {20 , Zi , 
. . . , zi\, ape(x) = Z1-2 . 

A path of length 2m — \x\ belonging to P f) K 0x reaches x either 
via A x or via B x . In the latter case the path cannot end in a loop of the 
first kind. By the hypothesis of induction, 

t-t, 2, c ro _!(?/,0) r yx = 2^ V 2^ ■ , 11 -T7T- 

X yiB x ViHx *tPf)Kou * *«*• I 2 

1 *' i(x)=2(m-l)-|«| 

, s (7) 

= e (-ir <,r) n ^r, 

Z(jt)=2to-|x| 
pe(jr)«flx 

the second equality following from (6). 

Now consider a path 7nr of length 2m — \x\, belonging to P fl K Qx , 
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reaching x via A x , and not ending in a loop of the first kind, i.e., with 
pe(7r) 7^ x. Using the hypothesis of downward induction, we find 

X v»A z nPRKay ztr \Z\ 

/(T)=2m-|x|-l 

(8) 

= e (-ir^n^r. 

r«J>n*0> *" \ Z \ 

pe(r)(A x 

the second equality again following from (G). 

Finally, we consider those paths of length 2m — \x\ belonging to 
P D K 0x which do end in a loop of the first kind. Such a path is of the 
form 

iryx 

with tr € P fl K 0x , l(v) = 2m - \ x \ - 2, and r,„ = 1, for some 
y e A x . We observe that in this case | y \ = \ x | -f- 1 and that 

(-D >( ' } (jj g(w) _ jj gM\ = (-0 >(,r) (J_ _ A n gU,z) 



n 



(-O'^TTffdr^) 



V 

Ht)+i (jWyx,!)) 



= (_ x y W +iVK*u+*, (9) 

(/(iryX,x) j-r gU,z) 

I X I 2C* I 2 I 

= (_!)'<'>+! JJ dUy^^) 

ztjrtfx I Z I 

We note that v(Tyx) = j>(7t) + 1, and that v(7r#) = v(7r). By summing 
formula (9) over paths of length 2m = \ x \ — 2 belonging to P D K 0x 
and over y e A x such that r Iy — 1, we obtain 

r±-jz: e {(-d""» n 9 -^ 

r«„=l I(T)=2m-|z|-2 

_(_!)"<»> JJ ffC»j£)\ = J^ (_!)-(') JJ g( y »g) ^ 10 ^ 

*«» | 2 | J rcJ>nJCox :ir Z 

/(x)=2m-|i| 
pe(r)fA y 
apc(x)=x 
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By the hypothesis of induction 

^E e (-ir w n^f = m s '-*-*W»- do 

I re | i /( .4 I i(PfiK»i z «» l z l I * I y fA * 

r xv =l I(ir)=2m-2-|x| 

Also, it can be seen that for y e A x 

{t t P C\ K 0y : 1(t) = 2m - | x \ - 1 and pe(ir) 9* x) 

\J{iry.TePr)K 0x ,r xy =l, and 1(t) = 2m - \x\ -2} (12) 

= {* e P C) K 0y : l(ir) = 2m - \y\\. 

Combining (8) and (10), using (11) and (12), and applying the 
hypothesis of downward induction, we find 

2 (-ir w n# 

H*)-a»-|«| 

pe(r)«A a 

= ,'Z E (-irn^-nZ'^M (13) 

iC I ytA x TriPC\K 0u zer \ % \ \ X \ V*A X 

I(x)-2nt-|»l 

= | — j £ [cm(yfi) — rxyCmixfl)}. 

I X I V tA x 

Together, (7) and (13) complete the inductive step. 

XV. CALCULATION OF C m (x,\) 

In order to give an explicit formula for c m (x,\) for X > we suppose 
that, for each path t on S, all the upward (in ^ ) transitions on x are 
of two kinds, denoted by the symbols X and e. (The calculation we 
present is more easily understood if the new calls labeled e are thought 
of as due to the increment e in calling rate, while those labeled X are due 
to the original calling rate X.) In other words, we consider the set of all 
paths 7T on S as (partially) labeled by assigning either X or e to each 
upward transition. Formally, we define a labeling X( • ) of a path tt = 
[xo , xi , . . . , xi\ to be any function defined for Xi , x 2 , . . . , x t with the 
property 

_ Je or X if Xi covers Xi-i , 
" [0 otherwise. 

The set of all possible labelings of a path ir is denoted by A(n-), and 
membership therein by the notation X(-) e A(t). The functions X(-) 
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should not be confused with the constant X. A path ir together with a 
labeling X( • ) of t will be called a labeled path and denoted by (ir,X( - ))• 
The index e(7r,X(-)) of a labeled path is the number of times X(.r) as- 
sumes the value e for x e ir. 

Let X( • ) e A(fl-) be a labeling of ir = j.r , .\\ , . . . , Xi) . The function 
/i(ir,X( ■),■) is defined by the condition 

h(lT,\( ■ ),X) = \x\ + \s(px) 

if .t is on ir and a loop of the first kind on ir ends at x, with the first 
(i.e., upward going) leg of the loop labeled e by X( • ), i.e., 

\(px) = e, 
and by 

in all other cases. 

For a path ir and a labeling X( • ) e A(7r), the function f(7r,X( • )) is 
defined by 

, w \\ (the number of loops of the first kind on 7r 
\labeled e on the upward leg by X( • )• 

Theorem 13: For X > and m ^ 

c (0,X) = 5 0m 

and for x > 0, 

r«pn*o. m» y + Xs (2/) ( 14 J 

X()«A(t) 
«(T,X(.))=m 

Note that by Theorem 5, with 2 = 0, formula (14) for m = reduces, 
as it should, to 

„/0 Px(X) 

Co(.-r,X) = r , . . 

Also, formula (14) agrees with formula (4), Theorem 12, as X is allowed 
to approach zero, since in this limit only (ir,\(-)) which are full of c's 
contribute, with m = \{l(ir) + | x \ ). 

Proof of Theorem 13: The values of c (.t,X) and c„,(0,X) are conse- 
quences of the definition 

± rux^) = &£-±4. (15) 

m=o Po(X + e) 
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The equilibrium condition Qp = for traffic parameter X + e comprises 
exactly the equations 

[\x\ + (X + e)s(x)]p x (\ + e) 

= E p,(x + + (x + E Pv(x + «)»■■• . * « s - 

Dividing by p (X + e) > 0, substituting the expansion (15), and col- 
lecting coefficients of like powers of e, we find that c„,(.i',X) for x e S 
satisfies the equation 

[\x\ + X.s-(.r)]c„,(.r,X) = E [fl*(tf,X) - JWWfoX)] 

(16) 

+ E r vx [c m ^(!J,\) + Xc m ( ? /,X)]. 

It can be verified, using the fact that for any labeling X( • ) of a path 
7r the number of times X(.r) has the value X for x c ir is 

l(ir) + | x | ( w \\ 
- 1 - e(ir,M-)), 

that formula (14) gives a formal solution of equations (16). 

To prove the theorem it suffices to show that the infinite sum over 
t e P f] Kox in formula (14) is absolutely convergent, and that the 
left-hand side of formula (15), with the c m (:r,X) as given by the theorem 
is absolutely convergent for e small enough. 

We first observe that for each tt and X( • ) summed over in formula 
the factors Ii(t,M • ),y) in 



h(ir,\( -),y) 

$*\ I y I + Xs(y) 



ii 



are uniformly bounded, and that at most min(m,j/(x)) of them are 
greater than unity. Also, the number of upward transitions (new calls) 
along a path -it e P C\ K 0l o( length l(ir) is just 

IM + I s I 



2 

Thus there are exactly 



AKtt) + h I * I \ 



ways of labeling the upward transitions on a path it e P f) K 0x with 
length I (it) and index m. 
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Hence for some constant a > 

/ Kt) + 1 x \ \ 
Ux,X) \^a m E \ M ««.m 2 II 



r.pn^o. \ /»■» I y I + ^ s (?/) " 



/// 



By Lemma 7, with j.r,- , i an integer} of the lemma defined in terms of 
the matrix Q appropriate to our congestion problem, 

E| X | + \s(x) J^ x(*+|x|)/J TT I 
. , m x.pn^A 11 



Xs(0) 'icJj'ir t» | y | + X*(2/) 

= Pr {.*< 5^ for 1 ^ i ^ fc | .r = 0|. 

By ex. 19, p. .378 of Feller, 4 there exists < q < 1 such that the proba- 
bility on the right is at most q for all k ^ | *S | . Hence 

J2 I c m (.r,X) | ^ const, a'" X] ( )'/• 
i>o *.-=« \m/ 

This proves that (14) converges absolutely, and that the left side of 
(15) converges absolutely for | e | small enough. 
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